User interface

ABSTRACT

A computer readable medium storing instructions which, when executed by a processor of a mobile handheld computer, cause the processor to present a user interface including a touch sensitive area in which a representation of a function is provided, wherein the function is activated in response to a multi-step operation including an object touching the touch sensitive area at a location where the representation is provided, and then the object gliding along the touch sensitive area away from the touched location irrespective of how far the object glides, wherein the function, when activated, causes the user interface to display user input controls at respective display locations that are determined prior to performance of the multi-step operation, and wherein any user gesture that activates a function and begins with an object touching the touch sensitive area at a location where the representation is provided causes the same response.

TECHNICAL FIELD

The present invention relates to a user interface for a mobile handheldcomputer unit, which computer unit comprises a touch sensitive area, andwhich touch sensitive area is divided into a menu area and a displayarea.

The computer unit is adapted to run several applications simultaneouslyand to present any active application on top of any other application onthe display area.

The present invention also relates to an enclosure for a handheldcomputer unit

The present invention also relates to a computer readable medium. Acomputer program product with computer program code is stored within thecomputer readable medium, which code, when read by a computer, will makeit possible for this computer to present a user interface according tothe invention.

DESCRIPTION OF BACKGROUND ART

Mobile handheld computers are known in various embodiments. One kind ofhandheld computer is the personal digital assistant (PDA), which isgetting more and more powerful.

Another kind of handheld computer unit is the mobile phone, which alsois getting more and more powerful. There are also examples of where themobile phone and the PDA are merging into one unit.

A third kind of handheld computer is the laptop computer, which isgetting smaller and smaller, even competing in size with the PDA's.

The need to manage more information has led the development towards newsolutions regarding user interfaces and navigation. The PDA's and mobilephones are getting larger and larger in order to provide a user-friendlyinterface.

Since the users have gotten used to small handheld units, it is hard tomove towards larger units. This has led to foldable keyboards, differentkinds if joy sticks and different kinds of touch sensitive displays andpads intended to help in providing a user interface that is suitable forsmall handheld computer units.

SUMMARY OF THE PRESENT INVENTION Technical Problems

It is a problem to provide a user-friendly interface that is adapted tohandle large amount of information and different kinds of traditionalcomputer-related applications on a small handheld computer unit.

It is a problem to provide a user interface that is simple to use, evenfor inexperienced users of computers or handheld devices.

It is a problem to provide a small handheld computer unit with an easilyaccessible text input function.

It is also a problem to provide a simple way to make the most commonlyused functions for navigation and management available in theenvironment of a small handheld computer unit.

Solution

Taking these problems into consideration, and with the staring pointfrom a user interface for a mobile handheld computer unit, whichcomputer unit comprises a touch sensitive area, which touch sensitivearea is divided into a menu area and a display area, which computer unitis adapted to run several applications simultaneously and to present anactive application on top of any other application on the display area,the present invention teaches that the menu area is adapted to present arepresentation of a first, a second and a third predefined function,where the first function is a general application dependent function,the second function is a keyboard function, and the third function is atask and file manager. The present invention also teaches that any oneof these three functions can be activated when the touch sensitive areadetects a movement of an object with its starting point within therepresentation of the function on the menu area and with a directionfrom the menu area to the display area.

With the purpose of providing a simple way of managing any applicationor the operations system, the present invention teaches that if thefirst function is activated, the display area is adapted to displayicons representing services or settings, depending on the current activeapplication. One of the icons always represents a “help”-service,regardless of application. The icons are adapted to represent servicesor settings of the operations system of said computer unit, such asbackground picture, clock, users, help, etc. if no application iscurrently active on the computer unit.

Selections of preferred service or setting is done by tapping oncorresponding icon

With the purpose of providing the access to a text input function in anyapplication in the computer unit, the present invention teaches thatwhen the second function is activated, the display area is adapted todisplay a keyboard and a text field,

If a text passage in an active application is highlighted, then thistext passage is displayed in the text field for editing through thekeyboard and that the highlighted text passage is replaced by the editedtext passage when the second function is deactivated.

If no text passage in an active application is highlighted, then thetext field is available for inputting and editing of text through thekeyboard.

In the case of the latter the first function can be activated, or thesecond function can be closed, in which a choice of saving or deletingthe inputted text is given. The choice of saving the inputted textresults in an activation of the first function. In this case the firstfunction will present services or settings available for the inputtedtext, such as saving the inputted text for later use, using the inputtedtext as telephone number in a telephone application, or sending theinputted text as message in communications application.

In order to provide a task and file management in a user interface for ahandheld mobile computer, the present invention teaches that, if thethird function is activated, the display area is adapted to display alist with a library of available applications and files on the computerunit A selection of an application will start the application, and aselection of a file will open the file in an application intended forthe file.

A selection of an application or a file is done by moving the object sothat the representation of desired application or file is highlighted,removing the object from the touch sensitive area, and then tapping onthe touch sensitive area.

According to the present invention a navigation in the list is performedby moving the object in a direction towards the top of the list ortowards the bottom of the list. This will cause the marking to move inthe same direction. The speed of the movement of the marking is lowerthan the speed of the movement of the object, with the purpose of makingthe navigation easier.

The user interface of the present invention is specifically adapted tobe used with a small computer unit where the size of the touch sensitivearea is in the order of 2-3 inches. The user interface is also adaptedto be operated by one hand, where the object can be a finger, such asthe thumb, of a user of the computer unit.

Advantages

Those advantages that can be primarily associated with a user interfaceor a computer readable medium according to the present invention residein the ability to establish a user-friendly interface for small handheldcomputers, both regarding general application set-up functions, textinput functions, and file and task management.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will now be described in more detail withreference to the accompanying drawings, in which

FIG. 1 is a schematic and highly simplified view of a touch sensitivearea on a mobile handheld computer unit;

FIG. 2 is a schematic side view illustrating the activation of afunction;

FIG. 3 is a schematic illustration of a first function;

FIG. 4 is a schematic side view illustrating the selection of a serviceor setting represented by an icon;

FIG. 5 is a schematic illustration of a second function;

FIG. 6 is a schematic side view illustrating the selection of a thirdfunction;

FIG. 7 is a schematic illustration of an application or file;

FIG. 8 is a schematic illustration on how navigation is performed;

FIG. 9 is a schematic illustration of how the content of the display areis changed;

FIG. 10 is a schematic side view further illustrating how navigation isperformed;

FIG. 11 is a schematic illustration of moving forwards in anapplication;

FIG. 12 is a schematic illustration of moving backwards in, or closing,an application;

FIG. 13 is a schematic illustration of an enclosure

DESCRIPTION OF EMBODIMENTS AT PRESENT PREFERRED

FIG. 1 illustrates a user interface for a mobile handheld computer unit.The user interface according to the present invention is specificallyadapted to computer units comprising a touch sensitive area 1, which isdivided into a menu area 2 and a display area 3. It should be understoodthat there are several different kinds of known touch sensitive displaysand that the present invention to does not depend on what kind of touchsensitive display that is used in relation to the inventive userinterface.

The computer unit is adapted to run several applications simultaneouslyand to present an active application on top of any other application onthe display area 3. It should be understood that by simultaneously it ismeant any technology that will make it appear to a user of the computerunit that applications are run simultaneously and that the presentinvention does not depend on how this is realised, whether it is throughtime-sharing of one processor, parallel use of several processors, orany other technique.

According to the present invention the menu area 2 is adapted to presenta representation of a first 21, a second 22 and a third 23 predefinedfunction.

The first function 21 is a general application dependent function, thesecond function 22 is a keyboard function, and the third function 23 isa task and file manager.

FIG. 2 shows that any one of these three functions 21, 22, 23 can beactivated when the touch sensitive area 1 detects a movement of anobject 4 with its starting point A within the representation of afunction on the menu area 2 and with a direction B from the menu area 2to the display area 3.

FIG. 3 shows that if the first function 21 is activated, then thedisplay area 3 is adapted to display icons 211, 212, 213, 214, 215, 216representing services or functions depending on the current activeapplication. One of the icons, in the figure exemplified by icon 211,always represents a “help”-service, regardless of application. Any keythat, because of lack of space on the display area, or because the keyshould be hidden from the active application, or because of any otherreason is not shown on the display area of an active application, can berepresented by one of the icons 212, 213, 214, 215, 216 that is shownwhen the first function 21 is activated.

If for instance the active application handles a picture, then the iconsthat are shown when the first function is activated can be services suchas “save to disk”, “send as SMS”, or “delete” and they can be settingssuch as “resolution”, “colour”, or “brightness”.

If no application is currently active on the computer unit, then theicons 211, 212, 213, 214, 215, 216 are adapted to represent services orsettings of the operations system of the computer unit, such asbackground picture, clock, alarm 215, users 213, help 211, etc.

FIG. 4 shows that selection of a preferred service or setting is done bytapping C, D on corresponding icon 213.

FIG. 5 shows that if the second function 22 is activated, then thedisplay area 3 is adapted to display a keyboard 221 and a text field222.

Two different scenarios can be at hand when this function key isactivated. A first scenario can be that a text passage in the activeapplication is highlighted as the second function is activated. If thisis the case then the highlighted text passage is displayed in the textfield 222 for editing through the keyboard 221.

The highlighted text passage is replaced by the edited text passage whenthe second function 21 is deactivated.

A second scenario can be that no text passage in the active applicationis highlighted. If this is the case then the text field 222 is availablefor inputting and editing of text through the keyboard 221.

In the case of the latter scenario, the first function 21 can beactivated, or the second function 22 can be closed. If the secondfunction 22 is closed then a choice of saving or deleting the inputtedtext is given, where the choice of saving the inputted text results inan activation of the first function 21.

As the first function 21 is activated with the second function 22 ascurrently active application the first function 21 will present servicesor settings available for the inputted text, such as saving the inputtedtext for later use, using the inputted text as telephone number in atelephone application, or sending the inputted text as message incommunications application, such as e-mail, SMS, or fax.

FIG. 6 shows that if the third function 23 is activated, then thedisplay area 3 is adapted to display a list 231 with a library ofavailable applications and files on the computer unit.

A selection of an application will start the application, and aselection of a file will open the file in an application intended forthe file. The name of a selected file can be edited by activation of thesecond function 22 as the file is highlighted.

FIG. 7 shows that a selection of an application or a file is done bymoving E the object 4 so that the representation of desired applicationor file is highlighted, removing F the object 4 from the touch sensitivearea 1, and then tapping G, H on the touch sensitive area 1.

An application or file is highlighted by placing some kind of marking232 on the representation of the application or file. This marking canbe done in different ways, for example by putting a frame around therepresentation of the application or file, as shown in the figure, or byinverting the representation of the application or file.

It should b understood that all lists in the computer unit, such as alist of contact information in an address book, a list of e-mailmessages in a mailbox, or a telephone log, can be managed in the abovedescribed manner.

The list 231 can be adapted to present only files or only applications.In this case, the top area of the list 231 can present a field 233through which the content if the list 231 can be altered. If the listonly presents files, then the field 233 can display a representation ofa task manager and a selection of the field 233 will cause the list 231to alter to present only applications, and if the list 231 only presentsapplications, then the field 233 displays a representation of a filemanager and a selection of the field 233 will cause the list 231 toalter and present only files.

FIG. 8 shows that navigation in the list is performed by moving theobject 4 in a direction I towards the top 231 a of the list 231 ortowards J the bottom 231 b of the list 231. This movement I, J of theobject 4 will cause the marking 232 to move K, L in the same direction.The speed of the movement K, L of the marking 232 is lower than thespeed of the movement I, J of the object 4.

FIG. 9 shows that if the number of applications and/or files in the list231 exceeds the number of applications and/or files that can bepresented on the display area 3, and if the object 4 is moved to the topor bottom position of the display area, then lifted, replaced on thedisplay area, and then again moved to the top or bottom of the displayarea, then the content of the display area will be replaced one wholepage, meaning that if the object 4 is positioned N at the bottom 3 b ofthe display area 3, then lifted, replaced on the display area 3, andthen again moved M to the bottom 3 b of the display area 3, then thecontent 31 of the display area 3 will be replaced P by the followingapplications and/or files 32 in the list 231. In the same way, but notshown in the figure, if the object is position at the top of the displayarea, then lifted, replaced on the display area 3, and then again movedto the top of the display area, the content of the display area will bereplaced by the preceding applications and/or files in the list.

FIG. 10 shows that if the object 4 is removed Q from a first position 33on the display area 3 and then replaced R, S on a second position 34 onthe display area 3, then the navigation can be continued T from thesecond position 34.

FIG. 11 shows that moving U the object 4 from the left of the displayarea 3 to the right of the display area 3 moves the active application,function, service or setting on one step forwards. FIG. 12 shows that,in a similar manner, the active application, function, service orsetting is closed or backed one step by moving V the object 4 from theright of the display area 3 to the left of the display area 3.

As shown in FIG. 1, the menu area 2 is positioned at the bottom of thetouch sensitive area 1. The representation of the first function 21 ispositioned at the left side of the menu area 2, the representation ofthe second function 22 is positioned at the middle of the menu area 2,and the representation of the third function 23 is positioned at theright side of the menu area 2.

As shown in FIG. 13, the present invention relates to a user interfacefor a hand held mobile unit that preferably can be manageable with onehand. Hence the present invention teaches that the user interface isadapted to a touch sensitive area 1 with a size that is in the order of2-3 inches, meaning the diagonal distance W between two corners of thetouch sensitive area 1.

The user interface is adapted to be operated by one hand, where theobject 4 can be a finger, such as the thumb shown in the figures, of auser of the computer unit. It should be understood though that thepresent invention might also be used with another object, such as a penor other pointing device.

According to one preferred embodiment of the present invention thecomputer unit is covered with an enclosure 5, which is provided with anopening 51 for the display area 3, and where the representations of themenu area 2 is printed on top of the enclosure 5. It should beunderstood that the opening 51 might be a transparent part of theenclosure 5 or that it might be an open aperture depending on amongother things technical considerations pertaining to the touch sensitivearea 1.

This makes it possible to allow the enclosure 5 to be removable andexchangeable.

FIG. 14 shows a computer readable medium, in the figure schematicallyshown as a solid-state memory 61. A computer program product is storedwithin the computer readable medium. This computer program productcomprises computer readable code 62, which, when read by a computer 6,will make it possible for the computer 6 to present a user interfaceaccording to the present invention.

The present invention also teaches that the computer program product isadapted to function as a shell upon an operations system.

It will be understood that the invention is not restricted to theaforedescribed and illustrated exemplifying embodiments thereof, andthat these embodiments can be modified within the scope of the inventiveconcept illustrated in the accompanying Claims.

1.-18. (canceled)
 19. A non-transitory computer readable medium storinginstructions which, when executed by a processor of a mobile handheldcomputer, cause the processor to present a user interface for the mobilehandheld computer, the user interface comprising a touch sensitive areain which a representation of a function is provided, wherein thefunction is activated in response to a multi-step operation comprising(i) an object touching the touch sensitive area at a location where therepresentation is provided, and then (ii) the object gliding along thetouch sensitive area away from the touched location irrespective of howfar the object glides, wherein the function, when activated, causes theuser interface to display a plurality of user input controls, in saidtouch sensitive area at a respective plurality of display locations thatare determined prior to performance of the multi-step operation, andwherein any user gesture that activates a function and begins with anobject touching the touch sensitive area at a location where therepresentation is provided causes the same response.
 20. The computerreadable medium of claim 19, wherein said touch sensitive area comprisesa display screen, and wherein the determined display locations aredistributed throughout the display screen.
 21. The computer readablemedium of claim 19, wherein the function, when activated, causes theuser interface to display a keyboard and a keyboard entry field at thedetermined locations.
 22. The computer readable medium of claim 19,wherein an active application, function, service or setting is advancedone step in response to a multi-step operation comprising (i) an objecttouching the touch sensitive area, and then (ii) the object glidingalong the touch sensitive area in a horizontal direction away from thetouched location.
 23. The computer readable medium of claim 19, whereinan active application, function, service or setting is closed or backedone step in response to a multi-step operation comprising (i) an objecttouching the touch sensitive area, and then (ii) the object glidingalong the touch sensitive area in a horizontal direction away from thetouched location.
 24. The computer readable medium of claim 19, whereinsaid instructions function as a layer upon an operating system.
 25. Thecomputer readable medium of claim 19, wherein the representation isfinger-sized.
 26. The computer readable medium of claim 19, wherein thelocation where the representation is provided does not provide touchfunctionality for a different function.
 27. The computer readable mediumof claim 19 wherein the function is not activated in response to a tapalone on the representation.
 28. The computer readable medium of claim19, wherein the user input controls comprise icons.
 29. The computerreadable medium of claim 19, wherein the user input controls comprisevirtual buttons.
 30. The computer readable medium of claim 19, whereinthe user input controls comprise a list of applications.
 31. Thecomputer readable medium of claim 19, wherein the user input controlscomprise a list of files.
 32. The computer readable medium of claim 31,wherein a desired file is selected in response to the object glidingalong said touch sensitive area so that the representation of thedesired file is highlighted, the object being raised from said touchsensitive area, and then the object tapping on said touch sensitivearea.
 33. The computer readable medium of claim 31, wherein the computerreadable medium stores items of at least two types and wherein saidtouch sensitive area presents an additional user input control forchanging the type of items displayed in the list, in response to theadditional control being activated.
 34. The computer readable medium ofclaim 31, wherein one item in the list is highlighted by a moveablemarking, and wherein the marking is moved in a direction towards the topor towards the bottom of the list, without scrolling the list, inresponse to the object gliding along said touch sensitive area in thatdirection.
 35. The computer readable medium of claim 31, wherein if thenumber of files in the list exceeds the number of applications or filesthat can be presented on said touch sensitive area, then the list ispaged up or down in response to the object (i) gliding along said touchsensitive area to the top or bottom of said touch sensitive area, then(ii) being raised above said touch sensitive area, then (iii) beingreplaced on said touch sensitive area, and then (iv) again gliding alongsaid touch sensitive area to the top or bottom of said touch sensitivearea.
 36. The computer readable medium of claim 31, wherein if theobject is raised from any first position on said touch sensitive areaand then replaced on any second position on said touch sensitive area,list navigation continues from the second position.